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Recent advances in quantum technology have led to the development and manufacturing of exper¬ 
imental programmable quantum annealers that promise to solve certain combinatorial optimization 
problems of practical relevance faster than their classical analogues. The applicability of such de¬ 
vices for many theoretical and real-world optimization problems, which are often constrained, is 
severely limited by the sparse, rigid layout of the devices’ quantum bits. Traditionally, constraints 
are addressed by the addition of penalty terms to the Hamiltonian of the problem, which in turn 
requires prohibitively increasing physical resources while also restricting the dynamical range of 
the interactions. Here, we propose a method for encoding constrained optimization problems on 
quantum annealers that eliminates the need for penalty terms and thereby reduces the number 
of required couplers and removes the need for minor embedding, greatly reducing the number of 
required physical qubits. We argue the advantages of the proposed technique and illustrate its 
effectiveness. We conclude by discussing the experimental feasibility of the suggested method as 
well as its potential to appreciably reduce the resource requirements for implementing optimization 
problems on quantum annealers, and its significance in the field of quantum computing. 


I. INTRODUCTION 

Many problems of theoretical and practical relevance 
consist of searching for the global minima of a cost func¬ 
tion defined over a discrete configuration space. These 
combinatorial optimization problems are not only noto¬ 
riously hard to solve but are also ubiquitous, appearing 
in a wide range of diverse fields such as machine learn¬ 
ing, materials design, software verification and logistics, 
to name a few examples [l|. It is no surprise then that 
the design of fast and practical algorithms to solve these 
has become one of the most important challenges of many 
areas of science and technology. 

One of the more novel approaches to optimization is 
that of Quantum annealing (QA) [H, a technique that 
utilizes gradually decreasing quantum fluctuations to tra¬ 
verse the barriers in the energy landscape in search of 
global minima of complicated cost functions. As an 
inherently quantum technique, quantum annealers hold 
the so-far-unfulfilled promise to solve combinatorial op¬ 
timization problems faster than traditional ‘classical’ al¬ 
gorithms |7Hllj . With recent advances in quantum tech¬ 
nology, which have led to the development and manufac¬ 
turing of the first commercially available experimental 
programmable quantum annealing optimizers containing 
hundreds of quantum bits [H, [3 ) interest in quantum 
annealing has increased dramatically due to the exciting 
possibility that real quantum devices could solve classi¬ 
cally intractable problems of practical importance. 

One of the main advantages of QA is that it offers a 
very natural approach to solving discrete optimization 
problems. Within the QA framework (often used inter- 
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changeably with the quantum adiabatic algorithm de¬ 
spite certain subtle differences), the solution to an op¬ 
timization problem is encoded in the ground state of 
a problem Hamiltonian Hp. The encoding is normally 
readily done by expressing the problem at hand as an 
Ising model, which has a very simple physical interpreta¬ 
tion as a system of interacting magnetic dipoles subjected 
to local magnetic fields. 

To find the solution, QA prescribes the following course 
of action. As a first step, the system is prepared in the 
ground state of another Hamiltonian Hu, commonly re¬ 
ferred to as the driver Hamiltonian. The driver Hamil¬ 
tonian is chosen so that it does not commute with the 
problem Hamiltonian and has a ground state that is fairly 
easy to prepare. As a next step, the Hamiltonian of the 
system is slowly modified from Hu to Hp, using a (usu¬ 
ally) linear interpolation, i.e., 

H{s) = sHp + il-s)Hd, (1) 

where s{t) is a parameter varying smoothly with time 
from 0 at t = 0 to 1 at the end of the algorithm, at 
t = T. If this process is done slowly enough, the adiabatic 
theorem of quantum mechanics [ij, [l^ ensures that the 
system will stay close to the ground state of the instanta¬ 
neous Hamiltonian throughout the evolution, so that one 
finally obtains a state close to the ground state of Hp. At 
this point, measuring the state will give the solution of 
the original problem with high probability. The running 
time T of the algorithm determines the efficiency, or com¬ 
plexity, of the algorithm and should be large compared 
to the inverse of the minimum gap [l^ . fl^ . [l7j | . 

In recent years it has become clear that while QA de¬ 
vices are naturally set up to solve unconstrained opti¬ 
mization problems, they are severely limited when re¬ 
quired to solve discrete optimization problems that in¬ 
volve constraints, i.e., when the search space is restricted 
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to a subset of all possible input configurations (normally 
specified by a set of equations). 

The standard canonical way of imposing these con¬ 
straints consists of squaring the constraint equations and 
adding them as penalties to the objective cost function 
with a penalty factor, transforming the constrained prob¬ 
lem into an unconstrained one (isl - l^ . This ‘penalty 
based’ method has several shortcomings. First, the 
squaring of the constraints normally results in a pattern 
of interactions that pairwise couple all the input vari¬ 
ables (an ‘all-to-air connectivity). When mapped to a 
set of qubits, this translates to the technically unrealistic 
requirement that the annealer admits programmable in¬ 
teractions between all pairs of qubits [^. The all-to-all 
connectivity requirement may be circumvented by ‘minor 
embedding’ the complete graph onto the hardware graph, 
however this process is not only very resource demand¬ 
ing, but it is also approximate in nature and is known to 
reduce the dynamical range of the qubit couplings consid¬ 
erably, while introducing additional constraints [1^ . 

Furthermore, due to the required all-to-all connectivity, 
the energy scale of the added penalty terms imposing the 
constraints must typically be quadratically larger than 
the scale of the original problem, which quickly over¬ 
whelms the dynamical range of the programmable inter¬ 
actions. 

In this work we propose an altogether different ap¬ 
proach to solving constrained optimization problems via 
quantum annealing in which we utilize suitably tailored 
driver Hamiltonians. Within our approach, the addition 
of penalty terms and all resulting complications become 
unnecessary. We will show that, when applicable, the an¬ 
nealing itself naturally takes place only in the subspace 
of configurations that satisfy the constraints and that the 
amount of resources required for the encoding of a prob¬ 
lems reduces dramatically. 


II. CONSTRAINED QUANTUM ANNEALING 
(CQA) 

We now present the basic principles of our approach. 
Let us consider an n-qubit problem Hamiltonian encod¬ 
ing a general (classical) discrete optimization problem, 
Hp{{af}), where the dependence of Hp on {crf}(L^, the 
set of Panli z-operators acting on the various qubits of the 
system, could be arbitrary. Let us also assume that the 
system is subject to a constraint C({af}) = c, where C 
is also assumed arbitrary and c is a real-valued constant 
(this approach trivially extends to the case of multiple 
constraints). 

Traditionally, imposing the constraint would consist of 
adding the ‘penalty’ term iLpenaity = [(^({crf}) — c]^ to 
the Hamiltonian, modifying it to Hp = Hp -|- aL/^enaitv, 
where a is a suitably chosen positive constant [l^ [l9 . 
[HI - [^ . As already discussed above, the addition of a 
penalty term is detrimental in several ways. First, it 
requires additional (normally two-body) interactions in 


the problem Hamiltonian, and since in practice actual 
devices would not be able to accommodate these, c ostly 
minor embedding techniques would be in order . 

Furthermore, the requirement that ground states of Hp 
map to those of Hp introduces an ‘extra energy scale’ to 
the cost function which in practice translates to increased 
error levels in the encoding of the couplings. 

Here, we suggest imposing constraints in a somewhat 
different manner. This is accomplished by first not¬ 
ing that since the constraint is ‘classical,’ as an opera¬ 
tor it trivially commutes with the problem Hamiltonian, 
namely, [Hp,C] =0. If one were to find a suitable 
driver Hamiltonian that also commutes with the con¬ 
straint, namely [Hd-, C] = 0 (while still not commuting 
with Hp), the constraint would become a constant of mo¬ 
tion, i.e., would obey [H, C] = 0 at every instant of time 
t during the course of the annealing. By further set¬ 
ting up the initial state of the system to be the ground 
state of the driver Hamiltonian in the relevant sector 
(C'({crf}))t=o = c, the dynamics will naturally take place 
in the subspace of ‘feasible’ configurations of the opti¬ 
mization problem, automatically obeying the constraint. 

Clearly, finding and setting up a suitable driver Hamil¬ 
tonian for every conceivable constraint may be difficult. 
However, as it turns out, the most common constraints 
that appear in the formulation of classically intractable 
combinatorial optimization problems have the form of a 
linear equality (see for numerous examples), specifi¬ 
cally C{{af}) = Y.l=i o-f = c. ^ 

Let us now consider now the driver Hamiltonian 

n 

Hd = -Y^ («+i + , (2) 

i=l 

where the label i = n -|- 1 is identified with i = 1. 
This driver is a special case of the well-known XY-model 
which was analytically solved in 1961 by Lieb, Schultz 
and Mattis [2^, [2^. This driver has the following at¬ 
tractive properties: i) as can easily be verified, it obeys 
{Hd,Y^^=i ®’f] “ ii) furthermore, it is a gapped model, 
having a non-de gen erate ground state, with a gap that 
scales as ^ 1/n [^; iii) it requires only basic two-body 
interactions, and only n of those; iv) finally, the XY 
model is not only exactly solvable, but may be mapped, 
via a Jordan-Wigner transformation, to a system of non¬ 
interacting spinless fermions. As such, it admits a very 
simple energy landscape, rendering its ground states in 
the various conserved sectors easily preparable. 

We note that within our constrained quantum anneal¬ 
ing (CQA) approach, evolution takes place in the sub¬ 
space of the full Hilbert space corresponding to those 
states belonging to the appropriate sector of the con¬ 
served quantity. Transitions to other sectors of the con¬ 
served quantity are hence suppressed. It is therefore ap¬ 
propriate to define the notion of relevant gap, which is 
the gap between the ground state and first excited state 
within the relevant sector. The relevant gap is the one 
with respect to which the adiabatic running time is to 
be estimated. Additionally, it is imperative that the 
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choices of driver Hamiltonian and initial state do not 
‘over-constrain’ the evolution, restricting it to a smaller 
subspace than the one prescribed by the constraint. 


III. EXAMPLES 

We now turn to illustrate the effectiveness of CQA by 
considering several examples set up to showcase both the 
generality of the method and its significance in reducing 
the amount of resources needed to embed optimization 
problems on quantum annealers. 


A. Graph Partitioning 


The first problem we tackle is that of graph parti¬ 
tioning (GP), where one considers an undirected graph 
G = (V, E) with an even number n = \V\ of vertices and 
is then asked to find a partition of V into two subsets 
of equal size {n/2) such that the number of edges con¬ 
necting the two subsets is minimal. GP is known to be 
an NP-hard problem, where the corresponding decision 
problem is NP-complete [3l| . As an Ising model, the GP 
problem can be written as 


H'p 


Up 0;idpenalty 



( 3 ) 


where the first term assigns positive cost to each edge 
that connects vertices belonging to different partitions, 
and the second is a constraint of the form [Gdcrf }) — c]^, 
with C({af}) = c = 0, that penalizes 

unequal partitions. The penalty factor a must obey 
a > min(2A, n)/8 where A is the maximal degree of 
G [ 2 ^ . It is easy to see that iLpenaity requires a complete 
(i.e., a fully connected) interaction graph. Furthermore, 
the energy scale associated with the penalty term scales 
with the size of the problem (unless the maximal degree 
of the graph is bounded). 

The above formulation may assume the usual 
transverse-field driver Hamiltonian Hd = 

However, choosing instead the driver presented in Eq. ([2l), 
the constraint commutes with the total Hamiltonian, 
Eq. ([T|) (here, Hp does not contain any penalties). Thus, 
the instantaneous eigenstates of H are also eigenstates of 
G({af}): if the initial state is an eigenstate of G({af}) 
with eigenvalue c, so will be the final state; i.e., the con¬ 
straint in this case is enforced by conservation laws and 
does not require a penalty term in the final Hamilto¬ 
nian. Interestingly, in this case, the constraint has a clear 
physical meaning, namely, that the search space is that 
of zero z-magnetization states [s^. Exploiting conser¬ 
vation laws obviates the need for a complete interaction 
graph, and dramatically reduces the amount of resources 
needed for the encoding of the graph. Within the stan¬ 
dard approach, one would need ^ edges, which on 


approach 

additional 

additional qubits 


edges 

after minor embedding 

penalty based 



CQA 

~ n 

n 


Table I. Additional resources needed for the encoding 
of fixed-degree graph partitioning problems. While 
for penalty based approaches the required resources scale 
quadratically with the original problem size, within CQA the 
growth is at most linear. 


an actual quantum annealer with a bounded degree con¬ 
nectivity would translate to requiring ^ v? additional 
qubits [ 2 ^, [l^. CQA on the other hand, is considerably 
less resource demanding, requiring at most n additional 
edges. This is summarized in Table HI 

It is important to note that the above choice of a care¬ 
fully tailored driver Hamiltonian may potentially come 
at a cost. One should verify that the minimum gap of 
the new driver does not scale worse with problem size 
than the usual transverse-field driver. To test this, we 
generated many instances of the GP problem and com¬ 
puted the scaling of the typical minimum gap. We chose 
random regular graphs of degree 6 (this subset of prob¬ 
lems is known to belong to the NP-complete complexity 
class). As a first step, we generated hundreds of ran¬ 
dom instances of different sizes n, up to n = 20. For 
the scaling of the minimum gap to be meaningful in the 
context of adiabatic quantum computing, we then hand¬ 
picked all those instances that had a unique ground state 
(up to a global bit-flip) so as to make sure that the cal¬ 
culated gap is the “relevant gap”, i.e., the gap between 
the ground state and an even excited state in the limit 
of s —>■ 1 with s being the adiabatic parameter. This was 
accomplished by exhaustively enumerating all energy lev¬ 
els of the generated instances. Figured] shows a random 
n = 12-bit instance. The figure also shows the required 
additional edges in the standard approach (left) and in 
the present CQA approach (right). While in the former 
method O(n^) additional edges are needed, in the latter 
case at most n additional edges are required. 

To calculate the gaps at different points along the an¬ 
nealing path, i.e., different values of s in the parametrized 
family of Hamiltonians H = (1 — s)Hd + sHp, we used 
exact diagonalization techniques (specifically, the Lanc- 
zos algorithm) to calculate the first few energy levels of 
the total Hamiltonian H. In both the standard approach 
and the CQA, the diagonalization was restricted to the 
relevant sector in which the evolution takes place. In 
the former case, this is the symmetric subspace, namely 
the eigenvalue 1 subspace of the parity operator P = 
0r=i^f- For CQA, the relevant subspace is the sym¬ 
metric subspace within the zero sector of the constraint 
G = the space of allowed conhgurations. An ex¬ 

ample of the gap calculations for a random 14-bit in¬ 
stance is given in Fig. [2| below. 

We then computed the minimum gap as a function of 
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problem size for instances with unique graph partitioning 
solutions, using traditional embedding and then CQA. In 
the standard traditional approach, the driver is the usual 
transverse-field driver, and the problem Hamiltonian is 
augmented by a penalty term. Since the latter contains 
^ terms, the problem Hamiltonian was further nor¬ 
malized by a factor of 1/n to make sure that its norm 
scales linearly with problem size in order to maintain the 
extensivity of the energy. In our CQA approach, neither 
penalties nor normalization is required and the cyclic XY 
model has been used as driver. Figure [3] shows the re¬ 
sults revealing a similar scaling for the two approaches, 
with the CQA gap being consistently about three times 
larger. 


B. Graph coloring 


We also considered the problem of graph coloring, that 
illustrates the versatility of the proposed technique to ad¬ 
dress the case of multiple disjoint constraints of the total 
magnetization type, namely, ^ ^ nonzero 

constant c. In graph coloring (GC), one is given an undi¬ 
rected graph G = (F, E), n = \V\, and a set of Uc colors, 
and the question is whether it is possible to color each 
vertex in the graph with a specific color, such that no 
edge connects two vertices of the same color 3l|. For a 
GC instance with ric colors, we assign ric spins to each 
node of G, associating i. to a qubit which is ‘up’ if 
vertex i is colored with color k, and is ‘down’ otherwise. 
The objective function then takes the form 


ric 

{ij)(iEk=l 


n 

+ a^ 
2=1 


fh Q 

^ik ~ (^c+2) 

.k=l 


(4) 



Figure 1. (Color online) Connectivity of a random 12- 
bit degree-6 graph partitioning instance. The black 
edges are those of the random instance, whereas the thicker 
green edges are the additional edges required to satisfy the 
constraint in the standard approach (left) and in the CQA 
approach (right). While ‘traditional’ penalty based embed¬ 
ding requires a fully connected graph, in the CQA approach, 
only six additional edges are required (so as to close a cycle). 



Figure 2. (Color online) First excitation gap for a ran¬ 
dom 14-bit degree-6 graph partitioning instance as a 
function of the adiabatic parameter s. The blue curve 
corresponds to the conservation law-based (CQA) embedding 
approach whereas the penalty based technique is the dashed 
red curve. Inset: Initial (Hd) gap, scaling inversely 
with problem size. 



Figure 3. (Color online) Exponential scaling of the typi¬ 
cal minimum relevant gap with problem size for ran¬ 
dom GP instances (log-linear scale). The resource- 
efficient CQA minimum gap (blue circles) scales similarly to 
that of the penalty based method (red squares), and is typi¬ 
cally about three times larger. 


The first term assigns a positive cost to every edge that 
connects two vertices of the same color, while the sec¬ 
ond term enforces the n constraints that each vertex has 
exactly one color, and provides an energy penalty each 
time any of these are violated (here a can be set to 1). 
A zero-energy ground state implies a solution to the col¬ 
oring problem on this graph with tic colors. The total 
number of spins required is thus n x ric, and the Uc spins 
for each of the nodes of G form a clique, i.e., a fully 
connected subgraph. 

As in GP, the cyclic XY driver can be used here as 
well, except that now there are n independent cycles, 
each associated with a different vertex of the graph, and 
composed of the ric qubits associated with that vertex. In 
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this case, each cycle will impose one of the n constraints. 
Such a choice of H 4 will then, as before, obviate the need 
for the ric-sized cliques prescribed by the traditional em¬ 
bedding. It is also instructive to consider here a driver 
Hamiltonian of the ‘clique’ form, namely. 


Hci = - 


E E 

k—l 


> (5) 


which requires cliques similar to the traditional embed¬ 
ding procedure, but has a constant initial relevant gap 
and does not require the introduction of a new energy 
scale into the problem. Since for each of the n con¬ 
straints, c = nc — 2 , the search space here is one in which 
all the spins belonging to the same vertex but one must be 
down (imposing one color per vertex). The above driver 
is effectively a sum of terms of the form — (Mj -|- My), 
where M^jy is the total magnetization of the spins for 
each vertex in the x/y direction. The ground state in 
this case is a direct product of the ground states in the 
various vertex subsystems, where the latter is the equal 
superposition of configurations with only one spin point¬ 
ing up. 


is one otherwise. In terms of Pauli operators acting on 
the bits involved in the clause, the Hamiltonian can be 
written using three-spin interactions as: 

= + , ( 6 ) 

i—1 

where are the values of the bits comprising \ jm) and 
i = 1, 2,3 labels the spins in the clause. 

Problems of the 3SAT type can be viewed as uncon¬ 
strained, with a Hamiltonian that is simply a sum of 
penalties . To apply the techniques presented here 
we shall treat some of these penalties as constraints that 
will then turn into conserved quantities (let us denote 
this subset of clauses by C) while the others remain a 
part of the Hamiltonian. We shall require that clauses 
identified as constraints involve mutually disjoint sets of 
spins. Within the new approach, the problem Hamilto¬ 
nian will consist only of ‘non-constraint’ clauses, explic¬ 
itly Hp = and as many of them as possible. 

This can be done due to the other constraints becom¬ 
ing immediately conserved operators provided a suitable 
driver is found. As for the driver Hamiltonian, we will 
choose for each clause m € C the driver 


C. Constrained satisfaction problems 

We now illustrate our approach for another important 
set of problems, namely, that of the constraint satisfac¬ 
tion type, which as we shall show gives rise to a differ¬ 
ent form of constraints. Constraint satisfaction problems 
(CSPs) play a dominant role in quantum annealing op¬ 
timization both because of their key role in complexity 
theory as well as their importance in many practical ar¬ 
eas. In fact, CSP was the first class of problems to be 
illustrated for a potential quantum annealing speedup @ 
and subsequent studies (see Refs. [MU and references 
therein). In a CSP instance there are n bits and m 
clauses, where each clause is a logical condition on a small 
number of randomly chosen bits. A configuration of the 
bits (spins) is a satisfying assignment if it satisfies all 
the clauses. A canonical example of CSP, which we con¬ 
sider here, is that of 3SAT wherein each clause consists 
of three bits, and the clause is satisfied for seven of the 
eight possible 3-bit configurations. 

In the traditional encoding of this type of problem in 
the quantum annealing framework, each bit variable is 
represented in the Hamiltonian by a erf operator, where 
i labels the spin. Each clause is then converted to an en¬ 
ergy function which depends on the spins associated with 
the clause, such that the energy is zero if the clause is 
satisfied and is positive if it is not. The problem Hamil¬ 
tonian Hp can then be written as a sum of terms, i.e. 
Hp = where m is the clause index and H^'^^ 

is the energy associated with the clause. The 3SAT clause 
Hamiltonian can be written as = \jm){jm\ 

where \ jm) is the 3-bit configuration which violates clause 
m. Here, the energy is zero if the clause is satisfied and 


H 


(m) 


= -Ei*) E <*'1=1 


( 7 ) 


iMr, 




— 8|-|-)(-|-| -I- 2V2 (|jm)(+| + |+)(jm|) — 2|jm)(jm| , 

where H^"^^ acts on the three bits in the clause and |-|-) 
is the fully-symmetric state. This driver, similarly to the 
problem Hamiltonian, involves 3-spin operators and can 
be written in terms of Pauli matrices since 


l+)(+l — g [1 + and 

i—1 

3 


( 8 ) 


\jm){+\ = 


1 


8^8 


[1 + o'f + (-l)^*’’"(icrf -I- erf 


The above driver ensures that the evolution is restricted 
to the subspace of configurations simultaneously satisfy¬ 
ing all of the constraint clauses. For all bits that are not 
present in the constraint clauses (let us label this set of 
bits K), a transverse-field term may be chosen. There¬ 
fore, the total driver Hamiltonian will be 


- E (9) 

mSM fceif 


with the corresponding ground state 

1^) = ®mGc('77 I*)) ®k^K 1+ )k- 

It is worth noting that other problems not discussed 
here may also benefit from suitably chosen driver Hamil¬ 
tonians. One such example has been studied in Ref. [s^ 
in the context of the traveling salesman problem, where 
four-body terms were used to construct the driver Hamil¬ 
tonian. 
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IV. CONCLUSIONS 

The method described in this study addresses one of 
the major obstacles to solving combinatorial optimiza¬ 
tion problems using quantum annealers and in a sense 
partially resolves it. We have shown that by choos¬ 
ing a suitable driver, one can exploit symmetries of the 
quantum annealing Hamiltonian to obviate the need for 
penalty terms to impose constraints as these are natu¬ 
rally enforced by the dynamics in the new approach. The 
removal of penalty terms in turn eliminates the required 
increased connectivity and the shrinking of the dynam¬ 
ical range of the interactions. Interestingly, the current 
approach is inherently quantum and does not have a clas¬ 
sical counterpart. As such, it may be viewed as providing 
a form of a ‘purely quantum enhancement’, which could 
become important in light of recent results pointin g to - 
wards the significance of tunneling in QA processes [^ . 

As we have demonstrated, a smart choice of initial 
Hamiltonian translates, in general, into a considerabe re¬ 
duction in resources, at times in orders of magnitude as 
in the case of graph partitioning. The significance of the 
method proposed here is therefore not only of theoreti¬ 
cal interest but of potentially immense practical signifi¬ 
cance. It touches deeply on the scales of problems that 
can actually be embedded to benchmark and evaluate 
experimental quantum annealers leading to capabilities 
far beyond currently testable problem sizes. As such the 
present method is expected to substantially contribute to 
the benchmarking capabilities of near-future experimen¬ 
tal quantum annealers potentially leading to exciting new 
discoveries of quantum annealing speedups. 

It remains to be seen how easy it is to experimen¬ 
tally engineer interactions of the form discussed above or 
any other useful interactions that naturally impose con¬ 
straints. Even though the usual transverse-field driver 
Hamiltonian may be easier to implement, these slightly 
more complex interaction terms can help to avoid some 
of the obstacles faced by practical quantum annealers. It 
is therefore not unreasonable to believe that the imple¬ 
mentation of driver Hamiltonians of the forms suggested 
above can have a considerable impact on the engineer¬ 
ing and, in turn, the success of experimental quantum 
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